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Abstract 

We propose a variable metric forward-backward splitting algorithm and prove its convergence 
in real Hilbert spaces. We then use this framework to derive primal-dual splitting algorithms for 
solving various classes of monotone inclusions in duality. Some of these algorithms are new even 
when specialized to the fixed metric case. Various applications are discussed. 
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1 Introduction 

The forward-backward algorithm has a long history going back to the projected gradient method 
(see [H [12] for historical background). It addresses the problem of finding a zero of the sum of two 
operators acting on a real Hilbert space T~L, namely, 

find x G U such that G Ax + Bx, (1.1) 

under the assumption that A : H — > 2^ is maximally monotone and that B : T~L — > H is /3-cocoercive 
for some /3 G ]0,+oo[, i.e. [3], 

(Vx G T-L)(\/y G %) {x - y \ Bx - By) > fi\\Bx - Byf . (1.2) 

This framework is quite central due to the large class of problems it encompasses in areas such 
as partial differential equations, mechanics, evolution inclusions, signal and image processing, best 
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approximation, convex optimization, learning theory, inverse problems, statistics, game theory, and 
variational inequalities IS IZl EH3 IIS QHl [201 1^1 121 - The forward-backward 
algorithm operates according to the routine 

x G U and (Vn G N) x n+1 = (Id +j n A)' 1 (x n - y n Bx n ), where < 7„ < 2/3. (1.3) 

In classical optimization methods, the benefits of changing the underlying metric over the course 
of the iterations to improve convergence profiles has long been recognized |191 133] . In proximal 
methods, variable metrics have been investigated mostly when B = in (jl.ip . In such instances 
(jl.3p reduces to the proximal point algorithm 

xo G % and (Vn G N) x n+ i = (Id+ r y n A)~ 1 x n , where 7„ > 0. (1.4) 

In the case when A is the subdifferential of a real-valued convex function in a finite dimensional 
setting, variable metric versions of (jl.4p have been proposed in [Til 123 EE]. These methods 
draw heavily on the fact that the proximal point algorithm for minimizing a function corresponds 
to the gradient descent method applied to its Moreau envelope. In the same spirit, variable metric 
proximal point algorithms for a general maximally monotone operator A were considered in [81 135] . 
In [5J, superlinear convergence rates were shown to be achievable under suitable hypotheses (see 
also [9] for further developments). The finite dimensional variable metric proximal point algorithm 
proposed in |32] allows for errors in the proximal steps and features a flexible class of exogenous 
metrics to implement the algorithm. The first variable metric forward-backward algorithm appears 
to be that introduced in [W\ Section 5]. It focuses on linear convergence results in the case when 
A + B is strongly monotone and T~L is finite-dimensional. The variable metric splitting algorithm of 
|28] provides a framework which can be used to solve (jl.ip in instances when T~L is finite-dimensional 
and B is merely Lipschitzian. However, it does not exploit the cocoercivity property (|l,2p and it 
is more cumbersome to implement than the forward-backward iteration. Let us add that, in the 
important case when B is the gradient of a convex function, the Baillon-Haddad theorem asserts 
that the notions of cocoercivity and Lipschitz-continuity coincide [4, Corollary 18.16]. 

The goal of this paper is two-fold. First, we propose a general purpose variable metric forward- 
backward algorithm to solve (|l.ip — (|1.2p in Hilbert spaces and analyze its asymptotic behavior, both 
in terms of weak and strong convergence. Second, we show that this algorithm can be used to solve 
a broad class of composite monotone inclusion problems in duality by formulating them as instances 
of (|l.ip — (|1.2p in alternate Hilbert spaces. Even when restricted to the constant metric case, some of 
these results are new. 

The paper is organized as follows. Section [2] is devoted to notation and background. In Section [3l 
we provide preliminary results. The variable metric forward-backward algorithm is introduced and 
analyzed in Section [41 In Section [51 we present a new variable metric primal-dual splitting algorithm 
for strongly monotone composite inclusions. This algorithm is obtained by applying the forward- 
backward algorithm of Section [4] to the dual inclusion. In Section [6l we consider a more general 
class of composite inclusions in duality and show that they can be solved by applying the forward- 
backward algorithm of Section [4] to a certain inclusion problem posed in the primal-dual product 
space. Applications to minimization problems, variational inequalities, and best approximation are 
discussed. 
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2 Notation and background 



We recall some notation and background from convex analysis and monotone operator theory (see 
[1| for a detailed account). 

Throughout, H, Q, and (Gi)i^i^ m are real Hilbert spaces. We denote the scalar product of a 
Hilbert space by (• | •) and the associated norm by || • ||. The symbols — and — > denote respectively 
weak and strong convergence, and Id denotes the identity operator. We denote by ¥>(H,C!) the 
space of bounded linear operators from Ti to G, we set 23 (H) = S (H,1-L) and § (H) = {l 6 S (T~L) \ 
L = -L*}, where L* denotes the adjoint of L. The Loewner partial ordering on S (H) is defined by 

(W G S(H))(W G §(U)) U^V (VxGH) {Ux I x) > (Vx | x) . (2.1) 

Now let q G [0, +oo[. We set 

Tain) = {U G S(ft) | U V aid}, (2.2) 



and we denote by y/U the square root of U £ T a (^). Moreover, for every U G TaiH), we define a 
semi-scalar product and a semi-norm (a scalar product and a norm if a > 0) by 



(VxG^)(VyG^) (a | y)^ = (C/x | y) and ||x||t/ = y/{Ux \ x). (2.3) 

Notation 2.1 We denote by C? = Q\@- ■ -©(7 m the Hilbert direct sum of the Hilbert spaces (Gi)i^i^ m , 
i.e., their product space equipped with the scalar product and the associated norm respectively 
defined by 



((• | •)): (x,y) >-+^2(xi | yi) and ||| • ||| : as i-)- 



8=1 



\ i=l 



where x = (xj)i^ m and y = (yi)i^i^ m denote generic elements in Q. 

Let A: % — > 2^ be a set- valued operator. The domain and the graph of A are respectively 
defined by domA = {x G 7~L \ Ax ^ 0} and graA = {(x,u) G % x % | -u G Ax}. We denote by 
zer A = jx G H | G Ax} the set of zeros of A and by ran A = {«6^ | (3 x G Ti) u G Ax} the 
range of A. The inverse of A is A" 1 :Hi->2 w :iii->{j;£^|?i£ Ax}, and the resolvent of A is 

J A = (Id+A)- 1 . (2.5) 

Moreover, A is monotone if 

(V(s,y) G U x n)(V(u,v) G Ax x Ay) (x - y \ u - v) ^ 0, (2.6) 

and maximally monotone if it is monotone and there exists no monotone operator B : % — > 2^ such 
that graA C gra£> and i/B. The parallel sum of A and B : % — > 2^ is 

AUB = {A~ 1 + B- l Y l . (2.7) 

The conjugate of /: % — > ]— oo,+oo] is 

f*:H^ [-co, +oo] : u i-> sup ( (x | u) - f(x)) , (2.8) 
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and the infimal convolution of / with g: % —J- ]— oo, +00] is 

/ □ g : U -> [-00, +00] : x ^ inf (f(y) + 5 (x - y)) . (2.9) 

yen 

The class of lower semicontinuous convex functions /:?{—> ]— 00, +00] such that dom / = {x G T~L \ 
fix) < +00} ^ is denoted by r ("H). If / G r (%), then /* G r (%) and the sub differential of / 
is the maximally monotone operator 

df : H -> 2 W : x ^ {u G ft | (Vy G H) (y - x | u) + /(x) < f{y)} (2.10) 

with inverse (df)" 1 = df*. Let C be a nonempty subset of Ti. The indicator function and the 
distance function of C are defined on T~L as 

f 0, if x G C; , , 

tc : 1 1-> < and etc = tc d ' : % l— ► inf x — y , (2.11) 

\+oo, if x^ C ' yec" y "' v ; 

respectively, the interior of C is intC, and the support function of C is ac = l* c - Now suppose that 
C is convex. The normal cone operator of C is 

n „, „<w ({« G ft | (Vy G C) (y-xU)<0|, ifxGC; 

A^c = <9ic* : ft — 2 : x 1— >• < IV ; W (2.12) 

I 0, otherwise, 

and the strong relative interior of C, i.e., the set of points x G C such that the conical hull of —x + C 
is a closed vector subspace of ft, is denoted by sriC; if ft is finite-dimensional, sriC coincides with 
the relative interior of C, denoted by ri C. If C is also closed, its projector is denoted by Pq, i.e., 
Pc ■ ft — > C : x 1— > argmin ygC .||x — y\\. 

Finally, ^i(N) denotes the set of summable sequences in [0, +00 [. 



3 Preliminary results 
3.1 Technical results 

The following properties can be found in [26, Section VI. 2. 6] (see |17t Lemma 2.1] for an alternate 
short proof). 

Lemma 3.1 Let a G ]0, +00 [, let jj, G ]0,+oo[, and let A and B be operators in S (ft) such that 
/uld A !>= B aid. Then the following hold. 

(i) a" 1 Id )p B- 1 )p A- 1 ^ /i" 1 Id. 

(ii) (Vx G ft) (A~ l x I x> > pll-^lxll 2 . 

(iii) \\A- X \\ ^ a -1 . 

The next fact concerns sums of composite cocoercive operators. 

Proposition 3.2 Let I be a finite index set. For every i £ L, let 7^ Lj G l B('H,Gi), 1st G 
]0, +00 [, and Ze£ Tj : ^ — > ^ 6e fii- cocoercive. Set T = Yliei L*TiLi an d P = ^/{J2iei ll^«ll 2 /A) - 
T/ien T zs f3- cocoercive. 
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Proof. Set (Vi G J) on = /3||Lj|| 2 //3j. Then ^ie/ a i = 1 anci > by convexity of || • || 2 and (|1.2 
(Vx £ "H)(Vy G 7{) (x - y | Tx - Ty> = £ (x - y | L*TiLiX - L^Uy) 

^ ^ f3i\\TiLiX - TiLiy\\ 2 



> XI Trni2 ll L i T * LiX ~ L i T i L iy\ 



= /3 y~] aJ — (L*TiLiX - L*TiLiy) 
= /3||Tx-Ty|| 2 , (3.1) 



which concludes the proof. □ 



3.2 Variable metric quasi-Fejer sequences 

The following results are from |17j . 

Proposition 3.3 Let a G ]0, +oo[, let (Wn)neN be in 7 a {T~L), 1st C be a nonempty subset of%, and 
let (x n ) ng N be a sequence in H such that 

(3 (r/„) neN G ^(N)) (Vz G C) (3 (e n ) neN G ^(N))(Vn G N) 

||x n+ i - z\\w n+ i < (1 + %)||sn - ^||w„ +^n- (3.2) 

TTien (x n ) n£ N is bounded and, for every z G C , (||x n — £||w n )neN converges. 

Proposition 3.4 Let a G ]0, +oo[, and let (Wn)neN a- n d W be operators in T a (T-l) such that W n — > 
W pointwise, as is the case when 

sup ||W n || < +oo and (3 (r? n ) neN G *+(N))(Vn G N) (1 + Vn )W n )? W n+1 . (3.3) 

neN 

Let C be a nonempty subset of%, and let (x n ) ng N be a sequence in T~L such that (|3.2p is satisfied. 
Then (x n ) ng N converges weakly to a point in C if and only if every weak sequential cluster point of 
(x n )neN is in C. 

Proposition 3.5 Let a G ]0,+oo[, let (W n ) n eN be a sequence in T a (7i) such that sup ngN ||W n || < 
+oo, let C be a nonempty closed subset ofH, and let (x n ) ng N be a sequence in % such that 

(3 (e„) neN G 4(N)) (3 (r/ n ) neN G ^(N))(W G C)(Vn G N) 

||x n+ i - Z\\w n+ i < (1 +Vn)\\Xn ~ z\\ Wn +£n- (3.4) 

Then (x n ) ng N converges strongly to a point in C if and only if dim dg (x„) = 0. 



Proposition 3.6 Let a G ]0, +oo[, let (f n )neN G ^+(N), and Zei (W n ) ng N 6e a sequence in T^T-L) 
such that sup neN ||W n || < +00 and (Vn G N) (1 + v n )W n+ i ^ W n . Furthermore, let C be a subset 
ofH such that int let z £ C and p G ]0, +oo[ 5e suc/i i/iat p) C C, and let (x n ) ng N a 

sequence in H such that 

(3 (e n ) neN G ^(N)) (3 (r? n ) neN G i\(N)) (Vx G p))(Vn G N) 

||x n+ i - X\\w n+1 ^ (1 + - ^||Wn +^n- (3.5) 

TTien (x n ) n£ N converges strongly. 
3.3 Monotone operators 

We establish some results on monotone operators in a variable metric environment. 

Lemma 3.7 Let A: % — > 2^ 6e maximally monotone, let a G ]0, +00 [, let U G < P a (ri), and let 
Q be the real Hilbert space obtained by endowing % with the scalar product (x,y) (x \ y)u-i = 
(x I U~ 1 y^. Then the following hold. 

(i) UA : Q — > iP is maximally monotone. 

(ii) Jjja - Q Q is 1-cocoercive, i.e., firmly nonexpansive, hence nonexpansive. 

(iii) J UA = (U- 1 +A)- 1 oU- 1 . 



Proof, (i) Set B = UA and V = U . For every (x,u) G gr&B and every (y,v) G gral?, 
Vu G VBx = Ax and Vv G VBy = Ay, so that 

(x — y I u — v) v = (x — y \ Vu — Vv) ^ (3-6) 
by monotonicity of A on T~L. This shows that B is monotone on Q. Now let (y, v) G H 2 be such that 

(V(x, n) G gra .B) (x — y | u — v) v ^ 0. (3-7) 
Then, for every (x,u) G gra A, (x,Uu) G graB and we derive from (|3.7|) that 

(x — y I u — Vv) = (x — y \ Uu — v) v ^ 0. (3-8) 

Since A is maximally monotone on %, (|3.8p gives (y, Vv) G gra^4, which implies that (y,v) G gral?. 
Hence, B is maximally monotone on Q. 



This follows from (i) and [H Corollary 23.8]. 
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Let x and p be in Q. Then p = Jjjax x G p + ?7.Ap 44> C7 1 x G (U 1 + A)p 44> 
p^JU- 1 + A)- 1 (U- 1 x). □ 

Remark 3.8 let a G ]0,+oo[, let U G !P a (%), set /: U -)• E: x h-> (jj- 1 ^ | x) /2, and let 
79 : (x, y) 1— >• /(x) — /(y) — (x — y | V/(y)) be the associated Bregman distance. Then Lemma 13 .TJliii 



asserts that Jjja = (V/ + A) 1 o V/. In other words, J^^ is the D-resolvent of A introduced in 
Definition 3.7]. 
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Let U G 7 a ^H-) for some a G ]0,+oo[. The proximity operator of / G To('H) relative to the 
metric induced by £7 is [251 Section XV. 4] 

prox^ : % — > % : x h-> argmin /(y) + — (3-9) 

j/e« 2 

and the projector onto a nonempty closed convex subset C of H relative to the norm || • is denoted 
by Pg. We have 

prox^ = Ju-igf and P^ = prox^, (3.10) 

and we write prox^ 1 = proxj. 

In the case when U = Id in Lemma 13.71 examples of closed form expressions for J\ja and basic 
resolvent calculus rules can be found in [U [T5| I18| . A few examples illustrating the case when 
U 7^ Id are provided below. The first result is an extension of the well-known resolvent identity 
J A + J A- 1 = 

Example 3.9 Let a G ]0, +oo[, let 7 G ]0, +00 [, and let U G ?a(?0- Then the following hold. 

(i) Let A: H — > 2^ be maximally monotone. Then 

J-yUA = ^/UJ^aVU^ 1 = Id-jUJ^-iu-XA-^U' 1 ). (3.11) 

(ii) Let / G T (H). Then prox^ = VW^ prax^^pr VU = Id -7C/- 1 prox^ ^~ l U). 



(iii) Let C be a nonempty closed convex subset of %. Then prox^ CTC = 
Id-7C/- 1 P^" 1 (7- 1 C7). 



Proof, (i) Let x and p be in TL. Then 



p = J^uax 44> x — p G 'yUAp 



Vu \-Vu 1 P £ jVuaVuVu l p 



& Vu l P = j iVUaVU {Vu l x) 

P = ^ j ,VuaVu(^ 1x )- ( 3 - 12 ) 

Furthermore, by [H Proposition 23.23(h)], J^j {lA )^u = ld-VU(U + (-fAy^VU. Hence, (|3TT21> 
yields 

J 7tM = Id -C/(C7 + ( 7 A)- 1 )~ 1 . (3.13) 

However 

p = (J/+ ( 7 yl)" 1 ) _1 x o x eUp + ('yA)~ 1 p 

44> 7 _1 p G A (a; - J7p) 
O x -Up G A _1 (7 _1 p) 
4^ 7 _1 C/~ 1 x G ( Id +7~ 1 L r ~ 1 A _1 ) (7 _1 p) 
^ 7" 1 P = «/ 7 -i C /-iA-i(7" 1 ^ 1 ^- (3-14) 



7 



Hence, (U + (7 A) ) = r )J 1 -^jj- 1 A- 1 (7 U ) anc b using ()3.13p . we obtain the rightmost identity 
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li) Apply (i) to A = df, and use (f3TT0|) . 
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Apply (ii) to / = <7c, and use (|3,10p . □ 



Example 3.10 Define Q as in Notation 12. 1\ let and, for every i G {1, . . . , m}, let Aj : Qi — > 

be maximally monotone and let t/j G ^({Jj). Set A: C? — )• 2 e : (xj)isgi<g m h-> X i=1 AjXj and 
l^i^m l— ^ (UiXi)i^i^ m . Then [/A. is maximally monotone and 

(V(xj)i^ m G <?) JuA(Xi)l^ m = (JUiAiXi)l^ m . (3.15) 

Proof. This follows from Lemma 13. 7|[i)| and [4, Proposition 23.16]. □ 

Example 3.11 Let a G ]0, +oo[, let £ G R, let U G ^(TY), let G r (M), suppose that / m 6 
and set i7 = {x G % | (x | «) ^ £} and 5 = </>((• | u)). Then g G ro(%) and 

prox,, /t^tt ||2 (x\u)-(x\ u) 



^ v x t n. j pi uj 

and 



(Vx£U) prc<x = x + 11 "Jl U~ L u (3.16) 

[|v Z7 1 n|| 2 



P v H x 



if (x I u) ^ £; 

e - (s I «> rr _i . f , , v * ( 3 - 17 ) 

(it I U~ L u) 

Proof. It follows from Example I3.9j(ii)| that 



( Vx G %) prox^ x = prox J tt-i y/Ux. (3.18) 



Moreover, go VU 1 = </>((• | VU 1 u)). Hence, using (|3. 18|) and [H Corollary 23.33], we obtain 
(Vx G U) prox^ x = Vu-ipiox^^r^ VUx 

prox,, /Ti—T no , (x I — (x I u) 
= xH u U u. (3.19) 



-Ml 2 



Finally, upon setting 4> = «-]-oo,£]j we obtain (|3. lTj) from (|3.16p . □ 

Example 3.12 Let a G ]0,+oo[, let 7 G R, let A G CP (%), let u G "H, let J7 G IP a (7£), and set 
99: % -> R: x i-> (Ax I x) /2 + (x | u) + 7. Then if G r (%) and 

(Vx€ft) prox^x = (Id+t/- 1 ^)-^^- J/- 1 ^). (3.20) 

Proof. Let x G 77. Then p = prox^ x 44> x — p = U~ 1 Vip{p) 4^ x — p = U~ 1 (Ap + u) 44> x — U~ lr u = 
(ld+U- l A)p ^p = (Id+C/- 1 A)- 1 (x - U- l u). □ 

Example 3.13 Let a G ]0,+oo[ and let U G 7 a {%). For every i G {l,...,m}, let r, G let 
G ]0, +00 [, and let Lj G 23 (71, Qi). Set </>: x h-> (1/2) X)i=i w «ll^i x ~~ r i\\ 2 - Then 99 G Fo(7Y) and 

Id+tT 1 J^WfXjLi J I x + C/~ 1 ^u; i .L*r i J. (3.21) 
i=l ' ^ i=l ' 

Proof. We have 92: x 1— >• (Ax | x) /2 + (x | u) + 7, where A = X]i=i ^i^A^ii u = — YaLi ^i^A r i-, an d 
7 = E™i^lN| 2 /2. Hence, (|5~^T|> follows from flQj) . □ 
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3.4 Demiregularity 

Definition 3.14 pfl Definition 2.3] An operator A: H — > 2^ is demiregular at x G donij4 if, for 
every sequence ((x n ,u n )) ng N in gr&A and every u G j4x suc/i i/iai x n — x and u n — > u, we have 

Lemma 3.15 [U Proposition 2.4] Let A: % — > 2" 6e monotone and suppose that x 6 dom^. T/ien 
A is demiregular at x in each of the following cases. 

(i) j4 is uniformly monotone at x, i.e., there exists an increasing function <fi: [0, +oo[ — > [0, +oo] 
that vanishes only at such that (Vii G Ax)(V(y, v) G gra^4) (x — y | u — v ) 0(||x — 

(ii) ^4 is strongly monotone, i.e., there exists a G ]0, +oo[ suc/i </mf A — aid is monotone. 

(iii) J a is compact, i.e., for every bounded set C C H, the closure of Ja(C) is compact. In 
particular, dom^4 is houndedly relatively compact, i.e., the intersection of its closure with 
every closed ball is compact. 

(iv) A : T~L — > % is single-valued with a single-valued continuous inverse. 

(v) A is single-valued on dom.A and Id — A is demicompact, i.e., for every bounded sequence 
(x n )neN in domvl such that (Ax n ) ng ^ converges strongly, (x n ) ng N admits a strong cluster 
point. 

(vi) A = df, where f G Tq(T-L) is uniformly convex at x, i.e., there exists an increasing function 
(f)\ [0, +oo[ — > [0, +oo] that vanishes only at such that (Va G ]0, l[)(Vy G dom/) fyotx + (1 — 
a)y)+a{l-a)4>{\\x-y\\)^af{x) + {l-a)f{y). 

(vii) A = df, where f G Tq(H) and, for every £ G R, {x G H \ f(x) ^ £} is boundedly compact. 



4 Algorithm and convergence 

Our main result is stated in the following theorem. 

Theorem 4.1 Let A: % — > 2^ be maximally monotone, let a G ]0,+oo[, let j3 G ]0,+oo[ ; let 
B-.H—tH be /3-cocoercive, let (?? n )neN G ^(N), and let (U n ) n& n be a sequence in < y a {H) such that 

H = sup \\U n \\ < +oo and (Vn G N) (1 + r} n )U n+ x ^ U n . (4.1) 

Let e G ]0, min{l, 2f3/(fi + 1)}], let (A n ) ng N be a sequence in [e, 1], Zei ( r y n )neN be a sequence in 
[e, (2/3 — s)/fj], let xq G %, and let (a n ) ng N and (6n)neN be absolutely summable sequences in H. 
Suppose that 

Z = zer(A + B) / 0, (4.2) 

and set 

Vn = x n - j n U n (Bx n + h 



(Vn G N) 

Then the following hold for some x G Z . 



X n +1 = X n + \ n {j~, n U n A (Vn) + a n - X n ) . 
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(ii) E„ eN \\Bx n - Bx\\ 2 < +00. 

(iii) Suppose that one of the following holds. 

(a) lim dzivcr,) = 0. 

(b) At every point in Z , A or B is demiregular (see Lemma \3.15\ for special cases). 

(c) int Z 7^ and there exists {vn)n&s £ £;j_(N) such that (Vn £ N) (1 + Vn)U n > U ri+ \. 

Then x n — > x. 
Proof. Set 

(A =<VU A {Pn = JA n yn 

(Vn G N) { n 1n n and { q n = J An (x n - B n x n ) (4.4) 

[B n = -y n U n B _ 

Then (|4.3|) can be written as 

(Vn G N) x n+ i = x n + X n (p n + a n - x n ). (4.5) 



On the other hand, f)4. 1[) and Lemma l34pT)fe; (iii) yield 



(Vn G N) II?/" 1 !! < ^e^fW), and (l + ^n^^n+X ( 4 -6) 

and, therefore, 

(Vn G N)(Vr G %) (1 + r/ n )||x||' ! ^ ||x||? U . (4.7) 

°n u n+l 

Hence, we derive from (g3|), JO}, Lemma l3w]ni)[ (j4T6|) and (|4~T|) that 



(Vn G N) ||x„ + i - Snlljj-i ^ A n (j|an|lc/-i + IK - QnWu-i) 

^ 1 1 1 1 U~ 1 "I - \\Vn "I - -^n^nlljy— 1 

< ll«n||[/-i + 7n II U n b n || j^- 1 

< ^Wn 1 ]] \\On\\ +JnVWn 



'Tl\\ "11 



< T k +VM ( 4 - 8 ) 

Now let z G Z . Since -B is /3-cocoercive, 

(Vn G N) (x n -z \ Bx n - Bz) ^ (3\\Bx n - Bzf. (4.9) 
On the other hand, it follows from f|4. 1[) that 

(Vn G N) ||5 n:Cn - B n z\\l-i ^ ll\\U n \\ \\Bx n - Bzf ^ j^\\Bx n - Bz\\ 2 . (4.10) 
We also note that, since — Bz G Az, (|4.4p yields 

(VnGN) z = J An (z-B n z). (4.11) 
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Altogether, it follows from (|QT|) . Lemma ETfii)j (02D, and (|QD]I that 



(Vn G N) ||g n - z||? a < 

^n 



\{x n - z) - (B n x n - B n z)\\ 2 i 

- ||(^n - 9n) - (^n^n ~ i 

l-^n Z \ rT i 2 (x n 2- I B n X n B n z) tt — l -)- ||.Z? n Xro B n z 



X 



n Hn 



) - {B n x n - B n z)\\ i 



x n - z\\ ! - 2j n (x n - z | -Bx n - 2?z) + ||-B„x n - B n ^|| 

U n U n 

- \\(x n ~ Qn) ~ (B n x n - B n z)\\ 2 x 

Un 

x n - z\\ 2 i - 7„(2/3 - n-f n )\\Bx n - Bz\\ 2 

Un 

- \\(x n - q n ) - (B n x n - B n z)\\ 2 i 

Un 

x n -z\\ 2 1 -e 2 \\Bx n -Bz\\ 2 

Un 



- \\(x n ~ Qn) ~ (B n x n - B n z)\\ 2 i. 
In turn, we derive from (|4.7p and (|4.4p that 



(VnGN) (1 + Vn) 



-ii 



i|2 ^ ii ||2 
Z\ rr-l ^ \\ s n ~ Z 

u n+l 



which implies that 

(Vn G 



< (1 - A n )||x n - z\\ 2 -i + A n ||g n - zW 2 -! 

U n U n 

^ \\x n -z\\ 2 nl -e 3 \\Bx n -Bz\\ 2 

Un 

- e\\(x n - q n ) - (B n x n - B n z)\\ 2 i, 

U n 



\s n - z\\ 2 i < (1 + r?n)||x n - z||?r-i - e 3 ||-Bx n - Bzf 



'n+l 



e\\{x n -q n )- (B n x n - B n z) 



1(7-1 

u n 



^ <5 2 ||x n — z\ 



tt-I; 



where 



Next, we set 



(Vn G 



5 = sup Vl + rfa. 



-/ 1 i „ 2/3 -e M1 
e n = d( -7=||a n || H — 1| fen 



a 



v 7 ^ 



Then our assumptions yield 

< +00. 

neN 

Moreover, using (|47f|) . (|4.14p . and ([4^8]) . we obtain 

(Vn G N) \\x n +i - z\\rj-i ^ \\x n +i - s n \\ v -i +\\s n -z\\ u -i 

n+l n+l n+l 



n 1 1 -^n -2 1 1 y— 1 &n 

< (1 + ??„)||x n - zlly-i + e n - 
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In view of (|4,6p . (|4.18|> . and (|4,19p . we can apply Proposition 13,31 to assert that (\\x n — z^-i)^^ 
converges and, therefore, that 

C = sup ||ar n — ^Hrr-i < +00. (4.20) 

neN 

On the other hand, (|377]l . (ETKL and Kl7\\ yield 

(Vrt G N) ||x n+ i-s„||2 ! < (l + %)||x n+ i-s n ||2 ! ^4. (4.21) 

U n+1 U " 

Hence, using KW\ . (ETToT) . (gUD, and (IQOjl . we get 

(Vn G N) ||x n+ i - z|| 2 1 <||s n -z||* 1 + 2||s n - z\\ v -i \\x n+1 - s n \\ v -i + \\x n+ i - s n \\ 2 1 

u n + l u n + l ^n+l ^n+l u n+l 

< (1 + r/„)||x n - z|| 2 x - e 3 ||.Bx n - Szll 2 

- e||x n - ? n - £„x n + B n z\\ 2 ! + 25C£n + £„ 

^ ||-^n -^ILf— 1 £ \\Bx n ^-^H ^][*^n Qn ^n^n H~ ■^n^ljrr— 1 

+ ( 2 r, n + 25te n + e 2 n . (4.22) 

Consequently, for every N G N, 

AT AT 



e 3 ||-Bx n - SzH 2 ^ ||x - z|| 2 1 - \\x N+ i - z\\ 2 1 + (C 2 ?/n + 2<5Ce n + 4) 

u U JV+1 ' — ' 

n=0 n=0 

AT 

< C 2 + Yl (CV + 25(e n + e\ ) . (4.23) 

n=0 

Appealing to (|4.18p and the summability of (f? n )neN; taking the limit as N — > +00, yields 

J2\\Bx n -Bz\\ 2 ^^(( 2 + Y,(( 2 Vn + 25(e n +e 2 n ) S ) < +00. (4.24) 

neN ^ neN ' 

We likewise derive from (|4.22|) that 

En 1 1 2 

\\x n ~ Qn - B n x n + BnzWy-i < +00. (4.25) 

neN 



(i) Let x be a weak sequential cluster point of (x n ) n6 N, say Xk n — 1 x. In view of (|4.19p . (|4.6p . and 
Proposition 13.41 it is enough to show that x G Z. On the one hand, (|4.24p yields Bxj~ n —> Bz. On 
the other hand, since B is cocoercive, it is maximally monotone [U Example 20.28] and its graph is 
therefore sequentially closed in % weak x % stron § [2[J Proposition 20.33(h)]. This implies that Bx = Bz 
and hence that Bxk„ — > -Bx. Thus, in view of (|4.24|> . 

\\Bx n -Bx\\ 2 < +00. (4.26) 

neN 

Now set 

(Vn G N) « n = -[^ 1 (i»-ft.)--Bi I , (4-27) 

7n 

Then it follows from (fO|) that 

(Vn G N) u n G Aq n . (4.28) 
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In addition, and (g55D yield 



|u„ + Brr|| = — ||f/„ - q n - B n x n + 5 n x) 

7n 



5a 



^ \\3>n Qn B n X n -\- B n X \\tt— l 

0. 



(4.29) 



Moreover, it follows from (|PJ) . (^T|) . and (|4T26|) that 

^ \\%n Qn ^n^n -B n x\\ ~\~ '")ri||^n|| ||^^n 

< \\x n - Qn ~ B n x n + B n x\\ + (2/3 - e)\\Bx n - Bx\\ 


and, therefore, since x kn — 1 x, that % n — x. To sum up, 

q kn x, n fcn -> --Bx, and (Vn G N) (qk n ,u kn ) G graA 



(4.30) 



(4.31) 



Hence, using the sequential closedness of gra^4 in % weak x % stron g [JJ Proposition 20.33(h)], we 
conclude that — -Bx G Ac, i.e., that x G Z. 



ii) Since the claim follows from (|4.24|) . 



(hi) We now prove strong convergence. 



(hi) (a) Since A and B are maximally monotone and dom5 = Ti, A + B is maximally monotone 



[U Corollary 24.4(i)] and Z is therefore closed [Jl Proposition 23.39]. Hence, the claim follows from 
(1)1 (f4TT9~|) . and Proposition [33J 



(iii)(b)| It follows from [(i)] and (|4.30p that q n -± x G Z and from (|4.29|) that u n ^ -Bx £ Ax. 
Hence, if A is demiregular at x, (|4.28j) yields q n — > x. In view of (|4.30p . we conclude that x n — > x. 
Now suppose that B is demiregular at x. Then since x n — 1 x G Z by (i) and .Bx n — )■ l?x by (ii) , we 
conclude that 



iii)(c) : Suppose that z G int C and hx /? G ]0, +oo[ such that B(z; p) C C. It follows from (|4.20p 



that 9 = sup x€ B{z . p) sup ngN \\x n - x\\ v -i (l/Va)(sup ngN \\x n - z\\ + sup a . 6B(a . p ) \\x - z\\) < +oo 
and from (pj~22]) that 

(Vn G N)(Vx G B(z; p)) \\x n+l - xf.,^ ^ \\x n - xf,,^ + 6 2 rj n + 256e n + e 2 n . (4.32) 



Hence, the claim follows from (i) Lemma \3.1\ and Proposition 13.61 □ 
Remark 4.2 Here are some observations on Theorem 14.11 



(i) Suppose that (Vn G N) U n = Id. Then (|4.3p relapses to the forward-backward algorithm studied 
in [TJ [TJ] , which itself captures those of [271 US HO] • Theorem 14.11 extends the convergence 
results of these papers. 
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As shown in [18} Remark 5.12], the convergence of the forward-backward iterates to a solu- 
tion may be only weak and not strong, hence the necessity of the additional conditions in 



Theorem 07] pii) 



(hi) In Euclidean spaces, condition (|4.ip was used in [32] in a variable metric proximal point 
algorithm and then in [28] in a more general splitting algorithm. 



Next, we describe direct applications of Theorem 14.11 which yield new variable metric splitting 
schemes. We start with minimization problems, an area in which the forward-backward algorithm 
has found numerous applications, e.g., [T5| \18 \ l2T | l39j l4"0]. 

Example 4.3 Let / G T (W), let a G ]0, +oo[, let /3 G ]0,+oo[, let g: % -> R be convex and 
differentiable with a l//3-Lipschitzian gradient, let (rj n ) n ^ G £\(N), and let (J7 n ) n eN be a sequence 
in 7 a ('H) such that (|4. 1[) holds. Furthermore, let e G ]0, min{l, 2/3/(/i + 1)}] where u is given by 
(|4.1|) . let (A n ) n£ N be a sequence in [e, 1], let (7 n )neN be a sequence in [e, (2/3 — e)/(j], let xo G H, and 
let (a n ) ne N and (6 n ) n eN be absolutely summable sequences in H. Suppose that Argmin (/ + g) ^ 
and set 

y n = x n - j n U n (Vg(x n ) + b n ) 
(Vn G N) (4.33) 
_ x n+ i = x n + X n { prox 7 ^ y n + a n - x n ) . 

Then the following hold for some x G Argmin (/ + g). 



l x n x. 



(ii) Znen l|Vg(x„) - Vg(x)\\ 2 < +oo. 
(hi) Suppose that one of the following holds. 

(a) hmd Argmin (j +9 )(a; n ) = 0. 

(b) At every point in Argmin (/ + g), f or g is uniformly convex (see Lemma l3.1^(vi) ). 



(c) int Argmin (/ + g) ^ and there exists (f n )neN G £j_(N) such that (Vn G N) (l + v n )U n ^ 
Then 



Proof. An application of Theorem 14. II with A = df and B = X7g, since the Baillon-Haddad theorem 
[U Corollary 18.16] ensures that Vg is /3-cocoercive and since, by [H Corollary 26.3], Argmin (/+(?) = 
zev(A + 5). □ 

The next example addresses variational inequalities, another area of application of forward- 
backward splitting [1 [231 [391 HQ]. 

Example 4.4 Let / G T Q (7i), let a G ]0,+oo[, let (3 G ]0,+oo[, let B: U -)■ U be /3-cocoercive, 
let (?7n)neN G ^j_(N), and let (£/ n )neN be a sequence in IP Q ('H) that satisfies (|4.ip . Furthermore, let 
e G ]0, min{l, 2/3/(u + 1)}] where [i is given by f)4. 1 1) . let (X n )neN be a sequence in [e, 1], let (7n)«eN 
be a sequence in [e, (2/3 — e)/u], let xo G and let (a n ) n£ N and (6 n ) n eN be absolutely summable 
sequences in %. Suppose that the variational inequality 

find x G U such that (Vy G %) (x - y | Bx) + /(x) < f(y) (4.34) 
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admits at least one solution and set 

X n ~ lnU n {Bx n + b 

Sn/ 

Then (x n ) ng N converges weakly to a solution x to (|4.34D 



(Vn G N) 



x n+ i = x n + X n ( prox^ 71 , y n + a r , 



(4.35) 



Proo/. Set A = df in Theorem E!|i)J □ 

5 Strongly monotone inclusions in duality 

In [13] , strongly convex composite minimization problems of the form 

minimize f(x)+g(Lx — r)-\ — \\x — z\\ 2 , (5-1) 

x£:l-L 2 

where z G H, r G Q, f G To(^), <? G To(^), and L G ¥>(7-l,G), were solved by applying the 
forward-backward algorithm to the Fenchel-Rockafellar dual problem 

minimize f*(z — L*v) + g*(v) + (v I r) , (5-2) 

where /* = /*D(|| • || 2 /2) denotes the Moreau envelope of /*. This framework was shown to 
capture and extend various formulations in areas such as sparse signal recovery, best approximation 
theory, and inverse problems. In this section, we use the results of Section 0] to generalize this 
framework in several directions simultaneously. First, we consider general monotone inclusions, not 
just minimization problems. Second, we incorporate parallel sum components (see ()2.7p ) in the 
model. Third, our algorithm allows for a variable metric. The following problem is formulated using 
the duality framework of [Hi . which itself extends those of E2 EH El E3 138] . 

Problem 5.1 Let z G H, let p G ]0, +oo[, let A: 'H — y 2^ be maximally monotone, and let m be 
a strictly positive integer. For every i G {1,... let G Qi, let Bi \ Qi — > c iP i be maximally 
monotone, let Ui G ]0, +oo[, let Di : Qi — > lP i be maximally monotone and fj-strongly monotone, 
and suppose that ^ Li G S (7i,Gi). Furthermore, suppose that 

zeran(A + f^L*((B i nD i )(L i --n))+ P Id). (5.3) 
^ i=i ' 

The problem is to solve the primal inclusion 

771 

findxG% such that z G Ax + L* {(Bj □ Di)(LjX - rj)) + px, (5.4) 

i=i 

together with the dual inclusion 



find v\ G Q\ , . . . , v m £ Q m such that 
(Vi G {1, ... ,m}) r. 



GL^Jp-iA^ 1 ^-!;^))) -B^vi-D^vi. (5.5) 
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Let us start with some properties of Problem 15,11 
Proposition 5.2 In Problem \5.1[ set 

m 

x = J p -i M {p' 1 z), where M = A + L * ( B i D A) ° {U ■ -n). (5.6) 

i=i 

Then the following hold. 

(i) x is the unique solution to the primal problem (|5,4p . 

(ii) The dual problem f)5.5j) admits at least one solution. 

(iii) Let («!, . . . ,1^7) 6e a solution to (|5.5p . T/ien x = J p -ia(/ 9_1 ( 2: ~~ SI^i ^t^))- 

(iv) Condition (|5.3|) is satisfied for every z in% if and only if M is maximally monotone. This is 
true when one of the following holds. 



(a) The conical hull of 



E = |(LjX -n- ^i)i<i<m x G domyl an d ( v i)l<Km G X ran (B i 1 + D i x )| 



(5.7) 



is a closed vector subspace. 

(b) A = df for some f G ro(%), /or every i G {1, . . . , m,}, = 3gj /or some ^ G To(Gi) and 
-Dj = dti for some strongly convex function li G To(Qi), and one of the following holds. 

1/ (n, ■ ■ ■ ,r m ) G sri{(LjX - y^i^m | xGdom/ and 

(Vi G {1, . . . , m}) yi G dom gi + dom li } . 
2/ For every i G {1, . . . , m}, gi or li is real-valued. 

3/ % and (Gi)i^i^ m are finite- dimensional, and there exists x G ri dom / suc/i i/iai 

(Vi G {1, . . . , m,}) LjX — rj G ri domgj + ri dom^j. (5-8) 



Proof, (i) It follows from our assumptions and [H Proposition 20.10] that p M is a monotone oper- 
ator. Hence, J p -im is a single-valued operator with domain ran(Id +/9 -1 M) [H Proposition 23.9(h)]. 
Moreover, (|5.3|) 44> /9 _1 z G ran(Id +/) _1 M) = dom J p -i M , and, in view of (|2.5p . the inclusion in 
is equivalent to x = J p -i M {p~ l z). 



ii) li (iii) It follows from and (gZD that 



(Vie {l,...,m}) WG (-BjD Di)(LiX- n) 
z ~ YT=i L tvi £ Ax + px 

(Vi G {1, . . . , m}) rj G LjX - -B^ 1 ^ - D^Wi 
y x = J p -i A (p~ l {z ~ E7=i L jW)) 
^ f («T, . . . ,*v) solves ([LSD ^ g ^ 



(3^g ai)---(3t^€ a„ 



<^> (3vi G £i) • • • (3v m G £ m ) 



(iv) It follows from Minty's theorem [U Theorem 21.1], that M + pld is surjective if and only if 



M is maximally monotone. 
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(iv)(a) Using Notation I2.1|, let us set 

L : % ^Q : {Lix) and B : Q -> 2 9 : y ^ {{B t □ D t )(y t - r i )) 1 



(5.10) 



Then it follows from JEB]) that M = A + L*oBoL and from dSTTJ) that £ = L(dom,4) - domB. 
Hence, since cone(I?) = span (E), in view of [6l Section 24], to conclude that M is maximally 
monotone, it is enough to show that B is. For every i G {1, . . . , m}, since Di is maximally monotone 
and strongly monotone, domD^ 1 = ran Di = Qi [4, Proposition 22.8(h)] and it follows from [U 
Proposition 20.22 & Corollary 24.4(i)] that BinDi is maximally monotone. This shows that B is 
maximally monotone. 



iv)(b) This follows from |16t Proposition 4.3]. □ 



Remark 5.3 In connection with Proposition [53 pv) let us note that even in the simple setting of 



normal cone operators in finite dimension, some constraint qualification is required to ensure the 
existence of a primal solution for every z G %. To see this, suppose that, in Problem 15. l\ % is the 
Euclidean plane, m = 1, p = 1, Q\ = ~H, L\ = Id, z = (C1X2), fi = 0, D\ = {0} _1 , A = Nc, and 
B l = N K , where C = {(6,6) G M 2 | (6 - l) 2 + £| ^ l} and K = {(6,6) G M 2 | 6 ^ 0}. Then 
dom(A + B\ + Id) = dom A n dom B\ = C C\ K = {0} and the primal inclusion z G + + x 
reduces to (6, C2) G AfcO + AfcO = ]-oo, 0] x {0} + [0, +oo[ x {0} = R x {0}, which has no solution 
if 6 7^ 0. Here cone(dom A — domBi) = cone(C — K) = —K is not a vector subspace. 



In the following result we derive from Theorem 14.11 a parallel primal-dual algorithm for solving 
Problem 15.11 



(5.11) 



Corollary 5.4 In Problem \5.1[ set 



1 1 V- ,1 r 

max 1 — y \\Li 



Let (a n ) ng N be an absolutely summable sequence in %, let a G ]0, +oo[, and let (r/ n ) n eN G ^+(N). 
For every i G {1, . . . , m}, let Vi t o G Qi, let (6j, n )neN and (di tn ) ne ^ be absolutely summable sequences 
in Qi, and let (Ui tn ) n ^n be a sequence in y a {Qi)- Suppose that 

p= max sup ||E/in|| < +00 and (Vi G {1, . . . , m})(Vn G N) (1 + r/ n )C/j jn+ i \J%^ n . (5.12) 

Let e G ]0, min{l, 2j3/{p + 1)}], let (\ n )neH be a sequence in [e, 1], and let ( r y n )n£N be a sequence in 
[e,(2p-e)/n]. Set 



(Vn G N) 



* - YT=i L>i 



Xn = Jp-iA(P ls n) + a n 

For i = 1 , . . . , m 

Wj,ra — ^i,n d - ^rJJ i,n{LiX n T{ Vi^ n C^n) 



(5.13) 



Then the following hold for the solution x to (|5,4p and for some solution (vx, . . . , v m ) to (|5.5 



(i) (Vi G {1, . . . ,m}) Vi 



In addition, x = J„-ia(p 1 { z ~ YliLx ^i v i))- 
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11 X r 



Proof. For every i G {1, . . . , m}, since Di is maximally monotone and z^-strongly monotone, D7 l 
is t'j-cocoercive with domD^ 1 = ranDj = Gi [4, Proposition 22.8(h)]. Let us define Q as in Nota- 
tion 12. 1| and let us introduce the operators 



T-.H^rH: X^r J p -i A {p~ 1 {z - x)) 
A: Q -»• 2 g : v \-> (B7 l Vi)^.. 

L : % — > g : x I—)- (Ljx) 1 



and 



(Vn G N) U n :g^g:v^ {U t , n Vi) l 



(i) In view of fl23J and d5HD , 



A is maximally monotone, 
.D is (mini^j^ m f j)-cocoercive, Lemma 137/ftn) | implies that 

— T is p-cocoercive, 
while || L || 2 ^ YliLi II -^11 2 • Hence, we derive from (|5.1ip and Proposition 

B = D — LTL* is /3-cocoercive. 
Moreover, it follows from (pU2j) . (f57T5|) . and (f!T4"l) that 



that 



sup ||J7 n || = n and (Vn G N) (1 + r] n )U n+ i >U n e 7 a {g). 



Now set 



(Vn G N) 



0"n — (pi,n) ^< 

Then ^neNlll a ™lll < SneN 111^111 < and (|5. 13|) can be rewritten as 



w n = v n - j n U n (Bv n + b n ) 

V n +l =V n + X n {J-y n U n A (W n ) + Cl n - V n ). 



(Vn G N) 

Furthermore, the dual problem (j5.5|) is equivalent to 

find v G g such that G Av + Bv 



(5.14) 



(5.15) 

(5.16) 
(5.17) 
(5.18) 
(5.19) 



(5.20) 



(5.21) 



(5.22) 



which, in view of ()5. 16j) . (|5.18p . and Proposition l5.^Tii)| can be solved using (|5.2ip . Altogether, the 



claims follow from Theorem 14. l|(i)| and Proposition [53 

Set (Vn G N) z 



m 



a n . It follows from (i) (I5J31) and ([5TT4"j) that 



x = T(L*v) and (Vn G N) z n = T(L*v n ). 



(5.23) 
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In turn, we deduce from (|5.17p . (i) , (|5,18p . and the monotonicity of D that 
2 -p\\T(L*v n )-T(L*v)f 



P\\Z n ~ X\ 



^ (L*(v n - v) | T(L*v) - T(L*v n )) 

< ((v n - v I LT(L*v) - LT(L*v n ))) 

< ((v n - v | Dv n - Dv)) - ((v n - v | LT(L*v r 
= ((v n -v I Bv n - Bv)) 



LT(L*v))) 



\Bv n - Bv\ 



(5.24) 



where 5 = sup ngN \ \\v n — v\\\ < +oo by (i) Therefore, it follows from (|5.21|) and Theorem I4.l|(ii) 
that \\z n — x\\ — > 0. Since a n — > 0, we conclude that x n — >• x. □ 



Remark 5.5 Here are some observations on Corollary 157 



(i) At iteration n, the vectors a n , b{ n , and d{^ n model errors in the implementation of the nonlinear 
operators. Note also that, thanks to Example I3.£|(i)[ the computation of t^n+i in (|5.13p can 
be implemented using J^-i v -i B rather than J lnU . B -i- 

(ii) Corollary 15.41 provides a general algorithm for solving strongly monotone composite inclusions 
which is new even in the fixed standard metric case, i.e., (Vi G {!,..., m})(Vn G N) TJ^ n = Id. 



The following example describes an application of Corollary 15.41 to strongly convex minimization 
problems which extends the primal-dual formulation (|5.ip - (|5.2p of [13] and solves it with a variable 
metric scheme. It also extends the framework of |14j . where / = and (Vi G {1, . . . , m}) 1% = i{o} 
and (Vn G N) U i>n = Id. 

Example 5.6 Let z G 7i, let / G Fq(H), let a G ]0, +oo[, let (rj n ) ne ^ G ^+(N), let (a n ) n6 N be an 
absolutely summable sequence in 7i, and let m be a strictly positive integer. For every i G {1, . . . , m}, 
let ri G Gi, let gi G Tq(G{), let Vi G ]0,+oo[, let t{ G Fo(Gi) be ^-strongly convex, let u^o £ £7ij 
let (6i, n )neN and (di, n )neN be absolutely summable sequences in Gi, let (f7i, n ) n eN be a sequence in 



^(^i), and suppose that ^ Li G 23 (7i,Gi)- Furthermore, suppose that (see Proposition 153 pv) (b) 
for special cases) 

z G ran (df + Y j L* i {dg i Udl i ){L i ■ -n) +Id Y (5.25) 
^ i=l ' 

The primal problem is to 

m j 

minimize /(x) + V] (gj □£ i )(L i x - rj) + -||rc - z|| 2 , (5.26) 
xgH i — * 2 
i=l 

and the dual problem is to 

z- y^L*Vi ) + (vi \n)). (5.27) 

2=1 ' 2=1 
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Suppose that (|5.12p holds, let e G ]0, min{l, 2/3/(u + 1)}], let (A n ) n£ N be a sequence in [e, 1], and let 
(7n)neN be a sequence in [e, (2/3 — e)//x] where /3 is defined in (|5.1ip and u in (|5. 12|) . Set 



(Vn G N) 



x n = proxj s n + a n 
For i = 1, . . . ,m 

«i,n+l = + A„ ( prox^™, t/^n + 6 ijn - Vi jn 



(5.28) 



Then (|5.26|) admits a unique solution x and the following hold for some solution (t>i,... ,v m ) to 
([OTP . 



(i) (Vi G {1, . . . ,m}) 



J. In addition, re = proxj(z — Y^=i ^t v i)- 



n x. 



X. 



Proof. Set A = df and, for every i G {1, ... , m}, P>i = dgi and -D, = <9£j. In this setting, it follows 
from the analysis of [16, Section 4] that (|5.26|) - (|5.27|) is a special case of Problem 15.11 and, using 
(|3.10p . that (|5.28|) is a special case of (|5,13p . Altogether, the claims follow from Corollary 15.41 □ 

We conclude this section with an application to a composite best approximation problem. 

Example 5.7 Let z G H, let C be a closed convex subset of H, let a G ]0, +oo[, let (r/„) ne N G ^+(N), 
let (a n ) ng N be an absolutely summable sequence in ~H, and let m be a strictly positive integer. For 
every i G {1, . . . , m}, let r, G <5j, let Z?j be a closed convex subset of Qi, let v^q G let (6j, n )neN 
be an absolutely summable sequence in Qi, let (£7i,n)neN be a sequence in 7 a (Qi), and suppose that 
/ Lj G 23 (H,Qi). The problem is to 



minimize \\x 

x&C 



+D 

m 



(5.29) 



Suppose that (|5.12p holds, that (maxi^ m sup ngN ||f7i, n ||) YliLi ll^«l| 2 < 2, and that 

(ri, ...,r m ) G sri{(LjX - ?/i)i<i< m | x G C and (Vi G {1, . . . ,m}) G A}- 

Set 



(5.30) 



Em 7- * 

Pcs n + a n 
For i = 1 , . . . , m 

v . .... / i t, u *< n I rr-i. 



(5.31) 



(Vn G N) 

a,' 

Then (x n ) n£ N converges strongly to the unique solution x to ()5.29p . 



Proof. Set f = ic and (Vi G {1, . . . , m}) gi = i^, = lsqx, and (Vn G N) j n = X n = 1 and dj jtl = 0. 
Then ()5.30p and Proposition 153 If iv) ((b))!/ imply that (|5.25p is satisfied. Moreover, in view of 
Example 133 Ifiii) (|5.31|) is a special case of (|5.28|) . Hence, the claim follows from Example I5.fc|(ii)[ □ 
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6 Inclusions involving cocoercive operators 



We revisit a primal-dual problem investigated first in |16| . and then in |41j with the scenario described 
below. 

Problem 6.1 Let z G H, let A: % — > 2^ be maximally monotone, let \i G ]0, +00 [, let C: % — > % 
be u-cocoercive, and let m be a strictly positive integer. For every i G {1, . . . , m} ; let G <5i, let 
-Bj : Qi —> lP i be maximally monotone, let V{ G ]0, +oo[, let D\ \ Q\ — >■ 2^* be maximally monotone 
and fj-strongly monotone, and suppose that 7^ Lj G 2 (?i,Qi)- The problem is to solve the primal 
inclusion 



find xeU such that z G Ax + ^ L*((Bj □ Dj){LjX - n)) + Cx 

i=l 

together with the dual inclusion 

find Ui G Q\ , . . . , «^ G <5 m such that 

(3 x G %) 

Corollary 6.2 In Problem \6.1[ suppose that 

z G ran (a + L* ((5* □ A)(£< • -r 4 )) + c\ 
^ i=i ' 



(6.1) 



z ~ YZi L Pi £Ax + Cx 
(Vi€ {l,...,m}) u< G (BiUD^LiX - n 



(6.2) 



(6.3) 
(6.4) 



and sei 

/3 = min{^,i/i, . . . ,v m }. 

Let e G ]0, min{l, f3}[, let a G ]0,+oo[, let (A n ) rag N &e a sequence in [e, 1], Ze£ xo G Zei (a n ) ng N 
and (c n ) ng N absolutely summable sequences in H, and let (U n ) ne n be a sequence in y a {%) such 
that (Vn G N) U n+ \ )p U n . For every i G {1, . . . ,m}, let u^o G <7i, and Zei (&i iTl ) n eN and (di, n )neN &e 
absolutely summable sequences in Qi, and let (Ui n ) n eN be a sequence in ^a^Qi) such that (Vn G N) 
Ui^n+i fc= An- ^ ?or every n G N, se£ 



v II y/Uj,nLj yUn 
\ i=i 



and suppose that 



Set 



8 n 



(l + (J n )max{||t7 n ||,||t7i, n | 



2/3 -e 



(Vn G 



I U m ,n 



Pn = Ju n A[x n - U n (Y^Li L*Vi,n + Cx n + c n - z)j +a n 

Un — 2p n X n 

For i = 1, . . . ,m 

Qi,n = Jjj i n B~ 1 {^i^ri + Ui,n(Liy n ~ -Dj "^i.n — dj )n — rj)J + fej 



(6.5) 



(6.6) 



(6.7) 



T/ien f/ie following hold for some solution x to (|6.1|) and some solution (vx,... ,v m ) to 
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(ii) (Vi G {1, . . . ,m}) v i<n -± Vi. 

(iii) Suppose that C is demiregular at x. Then x fi y x • 

(iv) Suppose that, for some j G {1, . . . , m}, Dj l is demiregular at vj. Then Vj yH — > Uj. 

Proof. Define Q as in Notation 12.11 and set 7C = T~L® Q . We denote the scalar product and the norm 
of K, by (((• | •))) and |||| • ||||, respectively. As shown in [13 HI]) the operators 

' A :K^2 k : (x,vi,...,v m ) i-> (E?=i L * v i ~ z + Ax ) x (n - L x x + B^Vi) x ... x 

(j"m L m x + B m v m ) 

B-.K^K: (x,vx,...,v m ) i-> (Cx, BfVi, • • • , D^v m ) (6.8) 



5 : /C ->■ /C: (a;,Ui, ... ,v m ) h-> f £™i . . . , -L m x\ 



are maximally monotone and, moreover, B is /3-cocoercive |41|. Eq. (3.12)]. Furthermore, as shown 
in [161 Section 3], under condition (|6.3p . zer(A + B) ^ and 



x solves (16.11) and i> solves (16.2 



(x,v) G zer(A + B) = 
Next, for every n G N, define 

U n : K^K: (x,Vx, . . . ,v m ) h-> (j7 n «, ^l.n^l, ■ ■ ■ , ^m,n« 

/C -> /C: (x,wi, . . . ,u TO ) (-)■ I C/^cc - ( - LjX + U^v i ) 1 



(6.9) 



(6.10) 



T n :U^g-.x^[ y/Ui, n Li_x, ... , yjU m)n L r , 



It follows from our assumptions and Lemma Ej^iii) that 

(Vn G N) C/ n+1 ^ J7„ g VJK) and lit/- 1 !! ^ -. (6.11) 

a 

Moreover, for every n G N, V n G S (7C) since £/„ G S (/C). In addition, (|6,10p and (|6.11|) yield 



i=l 



(Vn G N) ||V n || < lit/- 1 )! + where P=~ + 
On the other hand, 

m 

(Vn G N)(Vr G U) \\\T n x\\\ 2 = \\VUi^iVUnVUn~ x\\* 



(6.12) 



\\ x \\lf-l ^2 \\V U i,n L iVUn\ 



i=l 



fin \\x\ 



(6.13) 
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where (Vra G N) /3 n = 5^2=1 || v / k^-^V / ^n|| 2 - Hence, (j6.5|) yields 

(Vn G N) (1 + 



TT7T- (fU4) 
Therefore, for every n G N and every a; = (x, v\, . . . , v m ) G /C, using (|6.10p . ()6.13|) . ()6.14p . 



i X Vi 



Ml 2 



Ml 2 



h\\ 2 ur i 



-i 



Lemma 13. l|(ii)[ and (j6.6j) . we obtain 

? 

(«* | V n x))) = (s I U- X x) + I UrS) — 2 ^ (Li 

i=i i=i 

m m 

+ Y H^Hf/r 1 ~ 2 (\/ U i,riLiX | 
i=l 

m 

+ £ 

i=l 

2((^(l + 5 n )p n ~ l T n x I s/(l + *„)A,(v / C^~ 1 vi, ■•• , x/^VT 1 ^))) 

m 

+ (l + 5n)/?n^ 



Wlltf-i 



> IMIt/-i 



T n x I 



\(l + 5n)/3n 



i=l 
m 

"™ / II 1 1 2 i n i|2 \ 



i=i 



I7J-II 2 

1^11(7-1 

Z,71 



+ (1 + <5n)A» £ 



8=1 



i=i 



^(ipj-'W+Ei^ii-'i 

v i=i 



^ Cn 1 1 1 1 ^ I 



In turn, it follows from Lemma [571 Hii) and (|6.6|) that 
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(Vn G N) ||V~ A || < 7- < 20 -e 

Cn 



(6.15) 



(6.16) 



Moreover, by Lemma E^JJ (Vn G N) (E/ n+1 > E/ n U~ l > U'^ =>- V n > V n+ i ^ 
V" 1 ). Furthermore, we derive from Lemma 13. l|[ii)| and f)6. 12|) that 

(6.17) 
(6.18) 



(Vs g *c) (((v; 1 * 1 sb))) > HVnir 1 !!!^!!!! 2 > -||||x|||| 2 . 



Altogether, 
Now set, for every n G N 



sup || V; 1 |K 2/3 -e and (Vn G N) ^ € 3> 1/p (/C). 

neN 



x n — 


(Xni 'f l,n> • • • 




Vn = 


(Pni Ql,n> • • • > 


Qm,n) 


a n = 


(fl n , b± : ni • • • 5 


bm,n) 


Cn — 


(c n , , . . . , 




< d n = 




bl,n, ■ 



and b n = (S + V n )a n + c n - d n 



(6.19) 



J J' 1 b 



23 



Then Y^neN llll a nllll < +°°> SneN llll c nllll < +°°' and SneN llll^nllll < +°°- Therefore ()6.12[) 
implies that X^neN HH^IHI < +00. Furthermore, using the same arguments as in [HJ Eqs. (3.22)- 
(3.35)], we derive from (|6.7|) and (|6.8|) that 

(Vn G N) x n+1 = x n + X n \J v -i A (x n - V~ 1 (Bx n + b n )) +a n -x n j. (6.20) 

We observe that (|6.20p has the structure of the variable metric forward-backward splitting algorithm 
()4.3p . where (Vn 6 N) 7„ = 1. Finally, (|6.16|) and (|6.18p imply that all the conditions in Theorem 14. II 
are satisfied. 



(i) §2 (ii) Theorem I4.1|(i)| asserts that there exists 

x = (x, wl, . . . , u^) G zer( A + B) (6.21) 
such that x n — 1 x. In view of (|6.9p . the assertions are proved. 



(hi)P4(iv)| It follows from Theorem HJjpj)] that Bs n ->■ Bs. Hence, flEE), HEED, and (|HT2T^ yield 
Cx n -> and (Vi G {1, . . . , to}) £>~\ n -»■ A 7 ^- ( 6 - 22 ) 



Hence the results follow from (i) k (ii) and Definition 13.141 □ 

Remark 6.3 In the case when C = pld for some p G ]0, +00 [, Problem 16. II reduces to Problem l5.il 
However, the algorithm obtained in Corollarv l5.2l is quite different from that of Corollarv l6.2l Indeed, 
the former was obtained by applying the forward-backward algorithm (|4.3p to the dual inclusion, 
which was made possible by the strong monotonicity of the primal problem. By contrast, the latter 
relies on an application of (|4.3p in a primal-dual product space. 

Example 6.4 Let z G H, let / G To(H), let fj, G ]0, +00 [, let h : % — > R be convex and differentiable 
with a /i _1 -Lipschitzian gradient, let (a n ) n6 N and (c n ) n£ N be absolutely summable sequences in T-L, 
let a G ]0, +00 [, let m be a strictly positive integer, and let (U n ) n ^ be a sequence in y a {T-L) such 
that (Vn G N) f7 n +i )p= f7 n . For every i G {1, . . . , m}, let n G Gi, let ^ G To(^i), let Vi G ]0, +00 [, let 
1% G To(^i) be fj-strongly convex, let w^o G Gi, let (6j jn ) ng N and (c?j !n ) ne N be absolutely summable 
sequences in Gi, suppose that ^ G r B>{H^Gi), and let (J7j, n )neN be a sequence in T Q (^j) such 
that (Vn G N) Ui^ n+ \ t/j )n . Furthermore, suppose that 

z G ran (df + f^ L *i (% □ dl { ) (L { • -r») + V/i) . (6.23) 

^ i=i ' 

The primal problem is to 

m 

minimize f(x) + > (giD£i)(LiX — rj) + /i(x) — (x | z) , (6.24) 
x£H — ' 
i=i 

and the dual problem is to 

/ m \ m 

minimize (/* Uh*) ( z - V L* Vi j + V + + { Vi | r 4 ) ) . (6.25) 

Ol65l,.-.,tlme5m \ — f / — 7 

1=1 1=1 
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(Vn G N) 



Let /3 = min{^, v\, . . . , v m }, let e G ]0, min{l, /?}[, let (A n ) ng N be a sequence in [e, 1], suppose that 
(|6,6p holds, and set 

p n = prox^ n (x n - U n (YA=i L * v i,n + V/i(x n ) + c n - 2;) J + a n 

Vn — ^Pn %n 

For i = 1 , . . . , m 

qi, n = prox^' n (v i: n + U it n(Liy n - V£*(v i>n ) - d i>n -n))+ b it n 



(6.26) 



Then {x n ) n ^ converges weakly to a solution to (|6.24p . for every i E {1, . . . ,m} (wj jn ) ne N converges 
weakly to some vl G Qi, and (y±, . . . ,v m ) is a solution to (|6.25p . 



Proof. Set A = df, C = Vh, and (Vi G {1, . . . , m}) Bi = dgi and Di = di{. In this setting, it follows 
from the analysis of [16, Section 4] that (|6.24p - (|6.25p is a special case of Problem 16.11 and, using 



(|3. lQj) . that (|6.26p is a special case of (|6.7p . Thus, the claims follow from Corollary (6TWi)fc (ii) □ 



Remark 6.5 Suppose that, in Corollary 16 . 21 and Example l6.4l there exist r and {<Ji)\^i<^ m in ]0, +oo[ 
such that (Vn G N) U n = rid and (Vz G {1, . . . Ui^ n = <TjId. Then (|6.7p and ()6.26p reduce to 

the fixed metric methods appearing in [3H Eq. (3.3)] and [HI Eq. (4.5)], respectively (see [H] for 
further connections with existing work). 
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